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EXECUTIVE  SUMMARY 


This  document  presents  the  Terminal  Doppler  Weather  Radar  (TDWR)  Build  5a 
Operational  Test  and  Evaluation  (OT&E)  Operational  and  OT&E  Integration  Test  Plan. 
This  test  plan  is  written  in  accordance  with  FAA-STD-024a  and  PAA  Order  1810. 4B, 
and  provides  the  overall  philosophy  and  approach  to  OT&E  testing.  In  addition, 
this  test  plan  Identifies  OT&E  objectives,  responsibilities,  and  resources. 

The  TDWR  Build  5A  software  enhancement  provides  connectivity  to  the  Low  Level  Wind 
Shear  Alert  System  (LLWAS)  II  to  display  LLWAS  II  wind  data  along  with  TDWR 
hazardous  weather  data  on  TDWR  Geographical  Situation  Displays  (GSD)  and  Ribbon 
Display  Terminals  (RDT) . 

The  TDWR  Build  5A  OT&E  is  scheduled  to  occur  at  the  TDWR  site  in  Memphis,  TN, 

March  through  May  1994. 
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ACTION ■ 


The  Terminal  Doppler  Weather  Radar  (TDWR)  is  one  project  of  the  National  Airspace 
System  (NAS)  Plan,  whose  overall  goal  is  the  modernization  and  improvement  of  the 
government  systems  supporting  aviation  commerce  in  the  United  States.  In  the 
end-state  of  the  NAS  Plan,  the  TDWR  will  send  weather  product  information  to  air 
traffic  control  (ATC)  computers  at  the  Tower  Control  Computer  Complex  (TCCC) .  Also 
in  the  end-state,  a  mechanism  will  be  provided  to  transmit  TDWR  hazard  information 
directly  to  pilots.  The  end-users  of  TDWR  outputs  are  local,  approach,  and 
departure  controllers,  along  with  their  supervisors  and  pilots.  In  the  Interim 
NAS,  the  TDWR  product  information  will  be  displayed  to  air  traffic  specialists; 
i.e.,  controllers  and  controllers'  supervisors. 

The  Build  5  enhancement  is  intended  to  enable  the  TDWR  to  further  meet  the  goals  of 
the  NAS  Plan.  This  will  be  accomplished  by  interfacing  the  TDWR  to  the  Low  Level 
Wind  Shear  Alert  System  (LLWAS)  and  by  upgrading  some  existing  TDWR  functionality. 

The  Build  5  enhancement  for  the  TDWR  is  being  implemented  in  two  stages.  The  first 
stage  is  designated  as  Build  5A  and  the  second  as  Build  5B.  This  test  plan  will 
address  only  that  functionality  included  in  Build  5A.  In  addition,  the  test  plan 
has  been  tailored  to  address  only  those  Operational  Test  and  Evaluation  (OT&E) 
Integration,  0T6cE  Operational,  and  NAS-SS-1000  requirements  not  previously  verified 
during  baseline  OT&E.  However,  some  of  the  aforementioned  requirements  will  be 
reverified  to  ensure  baseline  performance  has  not  been  degraded  by  the  Build  5A 
enhancements . 

The  OT&E  Integration  and  OT&E  Operational  testing  has  been  completed  on  the 
baseline  TDWR  system.  All  NAS-SS-IOOO  requirements  successfully  verified  during 
previous  OT&E  will  be  identified  as  such  in  the  TVRTM  included  in  appendix  A.  Some 
of  these  requirements  will  be  verified  again  to  ensure  that  the  baseline  system 
performance  has  not  been  degraded. 

1.1  BACKGROUND. 

Build  5A  will  provide  an  Interface  to  the  Low  Level  Wind  Shear  Alert  System 
Phase  II  (LLWAS  II).  LLWAS  II  consists  of  six  sensors  and  a  computer  system  to 
process  wind  information.  Build  SA  will  accept  LLWAS  II  Center  Field  Wind  (CFW) 
and  display  them  on  the  Display  Functional  Unit  (DFU)  which  is  composed  of  a 
Geographic  Situation  Display  (GSD)  and  up  to  eight  Ribbon  Display  Terminals  (RDTs) . 
The  commercial-off-the-shelf  (COTS)  GSD  is  being  upgraded  to  the  Sun  SPARC  IPX 
workstation  as  part  of  Build  5A.  Also,  LLWAS  sensor  winds  can  be  mapped  to 
specific  runways  for  display  as  threshold  winds  on  the  GSDs  and  RDTs. 
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1.2  TEST  PHILOSOPHY. 


The  Federal  Aviation  Administration  (FAA)  conducts  OT&E  in  accordance  with  FAA 
Order  1810. 4B  to  evaluate  the  subsystem  operational  effectiveness  and  suitability 
including  compatibility,  interoperability,  degraded  operations,  survivability, 
maintainability,  and  supportability .  The  OT&E  also  identifies  deficiencies  in  NAS 
hardware,  software,  human  performance  factors,  and/or  operational  concepts.  The 
OT&E  consists  of  three  phases:  Integration,  Operational,  and  Shakedown.  Only  OT&E 
Integration  and  OT&E  Operational  phases  will  be  addressed  in  this  test  plan. 
Shakedown  activities  will  be  addressed  in  the  AOS-230  OT&E  Shakedown  Test  Plan. 
Division  of  responsibilities  for  FAA  OT&E  Integration  and  OT&E  Operational  testing 
are  illustrated  in  figure  1.2-1.  Since  Build  5A  is  an  enhancement  to  the  TDWR, 
only  those  blocks  not  shadowed  will  be  evaluated. 

L,?..! _ OT&E  Integration. 

The  OT&E  Integration  consists  of  testing  NAS  System  End-to-End  performance, 
specifically,  NAS-SS-1000,  volume  I,  system  level  and  volumes  II  through  V, 
subsystem  level  requirements  as  identified  in  the  TDWR  Test  and  Evaluation  Master 
Plan  (TEMP)  Verification  Requirements  Traceability  Matrix  (VRTM) .  This  testing 
establishes  NAS  baseline  performance  (end-to-end)  or  verifies  that  previously 
existing  NAS  performance  has  not  been  degraded.  To  the  greatest  extent  possible, 
the  subsystem  will  test  in  a  NAS  system  equivalent  environment. 

Testing  at  the  Memphis,  TN,  TDWR  site  (MEM)  will  address  and  evaluate  the  readiness 
of  the  system  for  integration  and  transition  into  the  field.  In  addition,  this 
activity  will  evaluate  the  system  performance  in  critical  test  areas,  test  the 
limits  of  system  performance,  and  provide  operational  performance  benchmarks. 

The  OT&E  Integration  effort  is  conducted  with  the  following  objectives: 

a.  Verify  the  TDWR's  capability  to  properly  interface  and  function  with 
the  associated  NAS  subsystems,  including  hardware,  software,  operational,  and 
maintenance  activities; 

b.  Ensure  the  early  detection  of  Interface  design  problems; 

c.  Minimize  site  problems  by  comprehensive  integration  testing  and 
evaluation; 

d.  Support  the  collection  of  system  reliability  figures; 

e.  Verify  the  requirements  of  the  NAS  System  Specification. 
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FIGURE  1.2-1. 


FAA  OT&E  TEST  PHILOSOPHY 


L2.2 _ OT&E  Operational. 


The  OT&E  Operational  testing  has  the  Intent  of  verifying  the  operational 
effectiveness  and  suitability  of  the  equipment  with  user  participation  In  the 
evaluation  testing.  Aspects  of  this  testing  are  further  defined  as  follows: 

a.  Reliability  and  availability; 

b.  Degraded  operations  and  operational  utilization  scenarios; 

c.  Stress  and  NAS  loading  testing  of  all  Interoperable  subsystems; 

d.  Human  factors; 

e.  Site-adaptation; 

f.  Transition  switchover. 

The  OT&E  Operational  testing  employs  system  users  to  assess  operational  suitability 
and  effectiveness  of  the  subsystem  in  the  NAS  environment.  Testing  will  be 
conducted  at  the  MEM  TDWR  site  in  accordance  with  established  OT&E  requirements. 
This  testing  will  address  the  evaluation  of  system  functions,  data  entry  and 
display  devices,  Human  Engineering  and  Computer -Human  Interface  procedures, 
training,  training  documentation  for  ATC  operations,  systems  maintenance,  and 
support  operations.  Tests  will  be  structured  in  a  building  block  fashion  starting 
with  an  evaluation  of  basic  functions  and  operations,  and  progressing  to 
evaluations  during  complex  Integrated  operations. 

The  OT&E  Operational  test  effort  is  conducted  with  the  following  objectives: 

a.  Verification  and  validation  of  the  operational  requirements; 

b.  Evaluation  and  determination  of  the  effect  of  the  segment  under  test  on 
the  operational  mission; 

c.  Identification  and  evaluation  of  the  safety  factors  involved  during 
transition  and  determination  that  transition  can  be  achieved  safely; 

d.  Evaluation  of  the  subsystem's  operations  and  maintenance  with  respect  to 
the  variations  In  site  configuration  and  adaptation; 

e.  Assessment  of  the  subsystem's  capability  to  support  current  and  future 
modifications . 

1.2. 2.1  Reliability  and  Availability. 

The  OT&E  will  be  conducted  to  estimate  and  verify  that  diagnostics  accuracy.  Mean 
Time  Between  Failure,  and  Mean  Time  Between  Critical  Failure  are  achievable  in  an 
operational  environment. 

1.2.2.2  _ Degraded  Operations. 

This  test  Is  conducted  to  determine  the  acceptability  of  the  resultant  operational 
degradation  when  failures  are  Induced  In  the  system.  This  Includes  validation  of 
shutdown  procedures,  startup  procedures,  degraded  operations  procedures,  and 
operational  impact  of  the  data  preservation  function. 
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This  test  estimates  the  levels  of  stress  and  NAS  loading  provided  by  the 
operational  environment. 

_ Human  Factors. 

This  test  estimates  the  degree  to  which  the  Interaction  of  personnel  with  the 
system  in  the  operational  environment  is  accommodated.  Test  and  evaluation  (T&E) 
should  explore  such  factors  as  the  physical  interaction  of  personnel  with  a  system, 
interactions  with  procedures ,  workloads ,  and  operational  environments . 

1.2 .2. 5  Site  Adaptation. 

This  test  ensures  that  site  data  unique  to  each  applicable  NAS  facility  has  been 
correctly  developed,  updated,  and  installed  in  the  system. 

1.2.2.^ _ Transition  Switchover. 

This  test  is  conducted  to  determine  whether  the  system  and  procedures  are  such  chat 
a  move  from  the  old  system  to  the  new  or  vice  versa  can  be  accomplished  without 
degrading  NAS  operations  while  minimizing  impact  on  the  user. 

1.3  EURPOSE  OF  TEST  PLAN. 

The  purpose  of  this  plan  is  to  ensure  that  comprehensive  OT&E  Integration  and  OT&E 
Operational  testing  is  conducted.  It  will  describe  the  test  program  and  identify 
organizational  responsibilities.  It  will  also  provide  a  basis  for  the  development 
of  OT&E  Integration  and  OT&E  Operational  test  procedures. 

1.4  SCOPE  OF  TEST  PLAN. 

This  plan  provides  for  the  comprehensive  testing  of  the  Build  5A  enhancement  to 
ensure  it  satisfies  user  and  NAS  requirements.  It  describes  the  OT&E  Integration 
and  OT&E  Operational  test  processes  for  ensuring  this  enhancement  meets  applicable 
subsystem/system  requirements  allocated  in  NAS-SS-1000,  volumes  I,  III,  and  V.  A 
similar  OT&E  Integration  and  OT&E  Operational  Test  Flan  will  be  generated  for  the 
TDWR  Build  5B  enhancement. 

1.5  DOCUMENT  OVERVIEW/ORGANIZATION. 

This  paragraph  describes  each  section  of  the  test  plan. 

Section  1.:  Introduction.  This  section  provides  an  introduction  to  the  TDWR 
Build  5A  OT&E  Integration  and  OT&E  Operational  Test  Plan.  In  addition,  it  provides 
the  purpose  and  scope  of  the  test  plan. 

Section  2 . :  Documents .  All  documents  directly  referenced  in  the  plan  and  all 
other  documents  related  to  this  plan  are  listed  in  this  section. 

Section  3.:  System  Description.  This  section  provides  a  brief  system  overview 
including  a  block  diagram.  It  also  identifies  the  current  and  future  interfaces. 
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Section  4.:  Test  Program  Description.  This  section  describes  the  OT&E  approach 
and  concept,  test  environment,  and  test  descriptions. 

Section  5.:  Test  Management.  This  section  defines  the  roles  and  responsibilities, 
training,  test  conduct,  test  reports,  schedules,  and  personnel  resource 
requirements . 

Appendix  A:  This  appendix  is  a  detailed  Test  Verification  Requirements 
Traceability  Matrix  (TVRTM) . 


2 .  DOCUMENT.*; 


This  section  lists  the  documentation  and  reference  materials  which  relate  to  the 
contents  of  this  plan. 

2.1  REFERENCED  DOCUMENTS. 


FAA-E-2806/1 

NAS -SS- 1000 

NAS -SS- 1000 

NAS -SS- 1000 

NAS -IR- 31023105 
Part  2 

NAS-IC-31055103-00 

NAS-IC-31055104-00 


Terminal  Doppler  Weather  Radar  Specification,  November  12, 
1992,  w/SCN  1,  January  2,  1993. 

NAS  System  Specification,  volume  I,  Functional  and 
Performance  Requirements  for  the  National  Airspace  System 
General,  October  1992, 

NAS  System  Specification,  volume  III,  Functional  and 
Performance  Requirements  for  the  Ground- to- Air  Element, 
February  1993. 

NAS  System  Specification,  volume  V,  Functional  and 
Performance  Requirements  for  the  National  Airspace  System 
Maintenance  and  Operations  Support  Element,  October  1992. 

Low  Level  Wind  Shear  Alert  System  (LLWAS) ,  Phase  II  to 
Terminal  Doppler  Weather  Radar  (TDWR)  Interface 
Requirements  Document. 

TDWR  Remote  Monitoring  Subsystem  (RMS)/Maintenance 
Processor  Subsystem  (MPS)  Interface  Control  Document. 

TDWR/Maintenance  Data  Terminal  (MDT)  Interface  Control 
Document . 


NAS-IC-31052201-00 

FAA-STD-024a 

No.  1810. 4B 


TDWR/Tower  Control  Computer  Complex  (TCCC)  Interface 
Control  Document . 

Preparation  of  Test  and  Evaluation  Documentation, 
August  17,  1987. 

FAA  NAS  Test  and  Evaluation  Policy,  October  22,  1992. 
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TDWR  TEMP 


Teirminal  Doppler  Weather  Radar,  Build  5  Revision,  Test  and 
Evaluation  Master  Plan,  November  1993. 


NAS -MD- 110 

NAS -MD- 790 

D001-Bld5-2 

B022-Bld5-1A 

B022-Bld5-2B 

B022-Bld5-3B 


Test  and  Evaluation  (T&E)  Terms  and  Definitions  for  the 
NAS,  March  27,  1987. 

Remote  Maintenance  Monitoring  System  (RMMS)  Interface 
Control  Document,  June  10,  1986. 

TDWR  Contractor's  Master  Test  Plan  (CMTP)  Build  5  Addendum, 
January  12,  1993. 

Build  5  Software  Requirements  Specification  Radar  Product 
Generation  (RPG)  Software,  CSCI-2  CGG551591,  Revision  A, 
November  19 ,  1992 . 

Build  5  Software  Requirements  Specification  Remote 
Monitoring  Subsystem  (RMS)  Software,  CSCI-3  CGG551592, 
Revision  B,  June  30,  1993. 

Build  5  Software  Requirements  Specification  Display 
Computer  (DPL)  Software,  CSCI-4  CGG551594,  Revision  B, 

June  24,  1993. 


1. _ SYSTEM  DESCRIPTION. 


The  primary  goal  of  the  TDWR  is  to  enhance  the  safety  of  air  travel  through  the 
timely  detection  and  reporting  of  hazardous  wind  shear  in  and  near  the  terminal 
approach  and  departure  zones  of  an  airport.  Specific  sources  of  hazardous  wind 
shear  to  be  detected  are  microbursts  and  gust  fronts.  The  secondary  goal  of  the 
TDWR  is  to  improve  the  management  of  air  traffic  in  the  terminal  area  through  the 
forecast  of  gust  front  induced  wind  shifts  at  the  airport,  as  well  as  detection  of 
precipitation. 

3.1  SYSTEM  OVERVIEW. 

3.1.1  Equipment  Description. 

The  TDWR  can  be  functionally  divided  into  three  subsystems:  radar  data  acquisition 
(EIDA) ,  Radar  Product  Generation/Remote  Monitoring  Subsystem  (RPG/RMS) ,  and  the 
Display  Functional  Unit  (DFU) . 

The  RDA  function  perfoirms  the  radar  data  collection,  detection,  signal  processing, 
clutter  suppression,  control  monitoring,  and  error  detection  subfunctions  for  the 
TDWR  system.  The  RDA  consists  of  the  Antenna  Group  (ANT)  which  includes  the 
Radome,  Pedestal  Assembly,  Tower  Assembly,  Reflector  Assembly,  Servo  Control  Unit 
(SCU) ,  and  Moving  Target  Simulator  (MTS).  The  RDA  also  includes  the  microwave 
pallet  and  redundant  Transmitters  (XMTs) ,  Receiver/Exciters  (REXs),  and  Digital 
Signal  Processors  (DSPs). 
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The  RPG/RMS  functions  process  moment/dwell  data  from  the  RDA,  exchange  control  and 
status  signals  with  the  RDA,  transmit  data  to  the  DFU,  and  provide  the  interfaces 
to  LLUAS  Il/IIl,  Remote  Maintenance  Monitoring  System  (RMMS)/Maintenance  Data 
Terminal  (MDT) ,  and  Tower  Computer  Control  Complex  (TCCC) . 

The  DFU  equipment  consists  of  a  Geographical  Situation  Display  (GSD)  for  viewing 
weather  products,  and  from  zero  to  eight  alphanumeric  Ribbon  Display  Terminals 
(RDT)  for  viewing  alert  messages.  GSD  capabilities  also  include  range  scale 
selection,  recentering  of  displayed  products,  selection  of  runway  configuration, 
and  archiving  of  weather  products . 

3.1.2  Equipment  Architecture . 

The  TDWR  system  is  configured  into  Hardware  Configuration  Items  (HWCIs)  and 
Computer  Software  Configuration  Items  (CSCls).  A  TDWR  HWCI  and  CSCI  block  diagram 
is  included  in  figure  3. 1.2-1. 

The  software  consists  of  operational  and  nonoperational  software.  Operational 
software  consists  of  operating  systems  (which  are  COTS  products) ,  application 
software  CSCls,  and  firmware  CSCls.  The  commercial  operating  systems  are  VRTX-32 
Operating  System  (CSCI-7)  for  the  68020  single  board  computers,  the  Data  Processing 
Operating  System  (CSCI-10)  for  the  RPG/RMS,  and  the  Display  System  Operating  System 
(CSCI-11)  for  the  DFU.  Nonoperational  software  which  is  not  part  of  TDWR  site 
installations  consists  of  the  Software  Development  Tools  (CSCI-5)  and  the  Test 
Tools  Library  (CSCI-6). 

The  HWCIs  consist  of  the  following: 

a.  Antenna  Group  (ANT)  HWCI-1 

b.  Transmitter  (XMT)  HWCI -2 

c.  Receiver-Exciter  (REX)  HWCl-3 

d.  Digital  Signal  Processor  (DSP)  HWCI -4 

e.  Radar  Product  Generator/Remote  Monitoring  Subsystem  (RPG/RMS)  HWCI -5 

f.  Display  Functional  Unit  (DFU)  HWCI-6 

g.  Special  Test  Equipment  (SPT)  HWCI-7 

h.  Program  Support  Facility  (PSF)  HWCI-8 
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FIGURE  3. 1.2-1.  TDWR  BLOCK  DIAGRAM 


The  CSCIs  consist  of  the  following: 

a.  Operational  Software 

1 .  Application  Software 

(a)  Digital  Signal  Processor  (DSP)  CSCI-1 

(b)  Radar  Product  Generator  (RPG)  CSCI-2 

(c)  Remote  Monitoring  Stibsystem  (RMS)  CSCI-3 

(d)  Display  Computer  (DPL)  CSCl-4 

(e)  Antenna  Control  (ANT)  CSCI-8  (Firmware) 

(f)  Transmitter  Control  (XMT)  CSCl-9  (Firmware) 

2.  Operating  Systems 

(a)  VRTX-32  Operating  System  (VTX)  CSCI-7 

(b)  Data  Processing  Operating  System  (DPO)  CSCI-IO 

(c)  Display  System  Operating  System  (UNIX_UNX)  CSCI-11 

b.  Nonoperatlonal  Software 

1.  Software  Development  Tools  (SDT)  CSCI-5 

2.  Test  Tools  Library  (TTL)  CSCI-6 

3.2  INTERFACES. 

Build  5A  will  provide  external  Interfaces  to  LLWAS  II,  Remote  Maintenance 
Monitoring  Subsystem  (RMMS) /Maintenance  Data  Terminal  (MDT) ,  and  Tower  Computer 
Control  Complex  (TCCC) .  These  Interfaces  are  shown  In  figure  3.2-1. 

3.2.1  LLWAS  II ■ 

The  TDWR  to  LLVAS  II  communications  Interface  will  consist  of  a  primal^  and  backup 
Interface,  and  Is  described  In  NAS -IR- 31023105,  Part  2,  Revision  A.  The  primary 
Interface  will  connect  the  TDUR  RPG  to  the  LLWAS  Tower  Display  port  on  the  LLWAS 
processor.  The  backup  Interface  will  connect  the  TDWR  Tower  GSD  to  the  LLWAS  Spare 
port  on  the  LLWAS  processor.  In  the  event  of  a  primary  Interface  failure,  the 
switch-over  from  primary  to  backup  will  occur  automatically.  Both  Interfaces  will 
operate  at  1200  bits  per  second  (bps).  Figure  3. 2. 1-1  presents  the  TDWR  -  LLWAS  II 
Interface . 
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FIGURE  3.2-1.  TDWR  BUILD  5A  EXTERNAL  INTERFACES 
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FIGURE  3. 2. 1-1.  TDWR--LLWAS  II  INTERFACE 
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The  TDUR  RPG/RMS  provides  the  following  interfaces: 

a.  RMMS:  The  RMMS  utilizes  the  MPS  to  remotely  control  and  monitor  the  TDUR. 
This  interface  is  described  in  NAS -MD- 790. 

b.  MDT:  The  MDT  is  located  at  the  TDUR  site  in  the  Concrete  Masonry  Unit 
(CMU)  and  is  used  to  locally  control  and  monitor  the  TDUR.  This  interface  is 
described  in  NAS -MD- 790.  This  interface  can  operate  at  1200,  2400,  4800,  and 
9600  bps. 

These  Interfaces  are  presented  in  figure  3. 2. 2-1. 


FIGURE  3. 2. 2-1. 


TDUR- -RMMS  INTERFACE 


The  TDVR  interfaces  to  TCCC  which  provides  for  transmission  of  products,  equipment 
status,  TDWR  modes,  and  receipt  of  commands.  When  the  TCCC  becomes  available, 
it  will  provide  data  to  appropriate  ATC  facilities.  It  operates  at  9600  bps  and 
is  described  in  NAS -IR* 22013105,  Revision  E.  This  Interface  is  presented  in 
figure  3. 2. 3-1. 


FIGURE  3. 2. 3-1. 


TDWR- -TCCC  INTERFACE 


In  order  to  determine  the  operability  of  the  TDUR  Build  5A  enhancement,  OTfiE 
Integration  and  OT&E  Operational  testing  requires  that  the  TDWR  be  installed  in  an 
operational  environment  with  operational  support.  An  operational  environment 
refers  to  the  configuration  into  which  the  TMIR  must  be  integrated.  For  this 
reason,  both  live  and/or  simulated  Interfacing  subsystems  and  equipment  will  be 
used.  Air  Traffic  (AT)  and  Airways  Facilities  (AF)  field  site  personnel  will  also 
be  requested  to  participate  in  test  efforts.  These  test  efforts  will  Include 
providing  support  writing  and  executing  the  detailed  test  procedures  that  will  be 
generated  by  ACV-200  to  verify  the  requirements  identified  for  testing.  The  TDWR 
OT&E  Integration  and  OT&E  Operational  testing  will  be  performed  using  all 
interfaces  available  and  appropriate  to  the  TDWR  system. 

^ ■ 1 ■ 1 — Operational  Issues/Test  Requirements  Snmmarv 

The  following  are  issues  related  to  the  Build  5A  enhancement: 

a.  LLWAS  II  wind  information  is  accurately  displayed  on  the  GSDs  and  RDTs. 

b.  TDWR/LLWAS  II  link  status  is  reported  accurately  to  the  RMMS  and  MDT. 

c.  The  performance  of  baseline  Build  4  has  not  been  degraded  using  Build  5A 
enhancements . 

All  NAS *SS> 1000  requirements  related  to  TDWR  have  been  included  in  Test 
Verification  Requirements  Traceability  Matrices  (TVRTM)  in  appendix  A.  The 
specific  Build  5A  requirements  which  will  be  tested  during  Build  5A  OT&E  are 
Identified.  Previously  verified  NAS  requirements,  which  will  not  be  fully  tested 
during  Build  SA  OT&E,  are  also  identified. 

^■>1. 2 — Preliminary  Activities  Leading  to  Testing. 

Prior  to  OT&E  Integration  and  OT&E  Operational  testing,  ACW-200  shall  prepare  the 
Build  5A  OT&E  Integration  and  OT&E  Operational  test  procedures.  In  addition,  the 
Build  5A  enhancement  will  have  successfully  undergone  extensive  Development  Test 
and  Evaluation  (DT&E) .  This  testing  is  conducted  by  the  prime  contractor  and 
witnessed  by  the  FAA.  Finally,  the  prime  contractor  will  install  the  Build  5A 
enhancement  and  successfully  complete  the  Build  5A  Interface  test  at  the  TDWR  site 
in  Memphis.  The  OT&E  Integration  and  OT&E  Operational  test  flow  diagram  is 
provided  in  figure  4. 1.2-1. 

4x1. 3 _ Planning  Considerations  and  Limitations. 

The  TDWR/TCCC  interface  software  will  be  tested  under  Build  5B  DT&E  testing.  The 
0T6£  testing  will  be  conducted  on  TDWR/TCCC  interface  during  Build  SB  OT&E. 
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FIGURE  4. 1.2-1. 


TEST  FLOW  DIAGRAM 


4.2  TEST  ENVIRONMENT. 

The  following  paragraphs  will  describe  the  test  facilities  where  the  OT&E  testing 
described  In  this  plan  will  be  conducted. 

_ Test  Location. 

The  Build  5A  enhancement  OT&E  Integration  and  0T6£  Operational  testing  will  be 
conducted  at  the  Memphis  International  Airport  (MEM)  TDWR  site  located  In  Nesblt, 
Mississippi . 

kJLl _ Test  Configuration. 

The  MEM  TDWR  Is  a  typical  site  Installation  Including  all  HWCIs  (except  HWCI-8)  and 
all  CSCIs  (except  CSCI-5  and  CSCI-6)  Identified  In  paragraph  3.1.2.  The  CSCIs  that 
were  modified  for  Build  5A  Include  CSCIs -2,  3,  and  4.  The  only  HWCI  modified 
for  Build  5A  Is  HWCI -6  where  the  Sun- IPX  workstation  will  replace  the  Sun  386 
workstation  as  the  GSD. 

An  LLWAS  anemometer  simulator  will  be  used  to  verify  that  the  TDWR  accurately 
displays  LLWAS  Center  Field  and  Sensor  winds.  An  MPS  simulator  and  a  TCCC  simulator 
will  be  used  to  verify  that  these  Interfaces  exist  and  are  functional.  Also, 
the  TDWR  Special  Test  Equipment  (HWCI-7).  Base  Data  Recorder  (BDR) ,  and  Base 
Data  Display  (BDD)  will  be  utilized  to  record  and  playback  TDWR  base  data. 

Protocol  analyzers  will  be  Installed  In  the  primary  and  backup  links  to  monitor 
TDWR/LLWAS  II  communications. 

_ Environmental  Conditions . 

A  lack  of  convective  weather  during  the  scheduled  test  period  could  Impact  the 
completion  of  testing.  Should  favorable  test  weather  not  occur,  testing  may  have 
to  be  extended  or  simulations  used.  One  solution  Is  to  playback  the  TDWR  base  data 
(previously  recorded  during  the  1993  OT&E  Operational  AT  Evaluation  In  Memphis) 
with  live  LLWAS  II  data. 

4.2.4  Test  Analysis  and  Tools. 

An  LLWAS  anemometer  simulator  will  be  used  at  the  LLWAS  Center  Field  Wind  sensor 
and  at  least  one  other  LLWAS  sensor  to  ensure  simulated  wind  speed  and  direction  Is 
accurately  displayed  on  the  TDWR  displays.  An  MPS  simulator  and  a  TCCC  simulator 
will  be  used  to  verify  that  those  TDWR  Interfaces  exist  and  are  functional.  The 
TDWR  Special  Test  Equipment  will  be  used  to  record  and  play  back  TDWR  base  data. 
Protocol  analyzers  will  be  used  to  monitor  TDWR/LLWAS  II  primary  and  backup 
communications  links. 
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4.3  OT&E  INTEGRATION  TEST  DESCRIPTIONS. 

4.3.1  TDWR.-LLWAS  II  Interface  Test. 

4. 3.1.1  _ Test  Objectives. 


This  test  will  verify  that  LLUAS  II  Center  Field  Wind  (CFW)  and  sensor  winds  are 
accurately  displayed  on  the  GSDs  and  RDTs. 

The  following  TVRTM  requirements  will  be  verified  under  this  test: 

3001,  3020,  3021,  3022,  3024,  3053. 

^.3.1.2 _ 

An  LLUAS  anemometer  simulator  will  be  used  to  simulate  wind  speed  and  direction  at 
the  CFW  sensor  and  one  other  sensor  that  has  been  mapped  to  a  runway.  The  GSDs  and 
RDTs  will  be  monitored  as  the  wind  speed  and  direction  are  varied.  This  test  is 
similar  to  the  test  that  was  used  to  verify  Build  4+  functionality.  This  test 
scenario  will  utilize  both  TDWR  operational  and  maintenance  modes. 

4.3.2  TDWR.-RMMS  Interface  Test. 

^.3.2.1 _ Test  Oblectlves. 

The  objective  of  this  test  is  to  verify  that  the  TDWR--MPS  and  the  TDWR*-MDT 
Interfaces  exist  and  are  functional.  ACN-IOOD,  with  assistance  from  ACU-200D, 
will  conduct  Build  5  OT&E  Integration  to  verify  NAS-SS-1000,  volumes  III  and  V 
requirements  for  the  TDWR--MPS  and  TDWR--MDT  interfaces  after  the  baseline  Interim 
Monitor  and  Control  Software  (IMCS)  module  has  been  completed  and  tested.  The 
Build  5A  modifications  to  the  TDWR--MDT  interface  will  be  verified  during  OT&E 
Operational  testing. 

TVRTM  requirement  3054  will  be  verified  under  this  test. 

4. 3. 2. 2  Test  Approach. 

The  system  MDT  will  be  used  to  control  and  monitor  TDWR  throughout  Build  5A 
OT&E  Integration  and  OT&E  Operational  testing.  During  OT&E  Operational  Degraded 
Operations  scenarios,  the  LLWAS--RPG  and  LLUAS- -DFU  communications  performance 
parameters  will  be  verified  using  the  system  MDT. 

4.3.3  TDWR--TCCC  Interface  Test. 

This  test  will  ensure  there  is  a  functional  port  allocated  for  TCCC.  This  test 
will  be  conducted  during  Build  5B  OT&E  and  will  be  further  addressed  in  the 
Build  5B  OT&E  Integration  and  OT&E  Operational  Test  Flan.  ACN-300,  with  assistance 
from  ACW-200D,  will  perform  OT&E  Integration  when  the  TCCC  becomes  available. 
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System  operation  will  be  monitored  to  verify  that  diagnostic  accuracy,  Mean  Time 
Between  Failure  (MTBF)  and  Mean  Time  Between  Critical  Failure  (MTBCF) ,  are 
achievable  in  an  operational  environment.  This  data  will  be  used  to  support  the 
data  collected  during  baseline  OT&E  Operational  testing,  as  well  as  verify  that  the 
Build  5A  enhancement  has  not  degraded  TDVR  system  reliability/availability . 

^■^.1.2 _ Test  Approach. 

During  Build  5A  OT&E  test  conduct,  all  TDWR  system  failures  will  be  recorded  and 
classified  as  critical  or  noncritical.  For  system  reliability  tests,  the  TDWR 
will  be  run  in  a  Hands-Off  mode  and  it  will  be  verified  that  any  failures  of 
Interrelated  NAS  subsystems  do  not  affect  TDWR  reliability.  Diagnostics  will  be 
performed  in  event  of  a  failure  and  all  diagnostic  results  will  be  recorded.  In 
the  event  of  critical  failure,  the  system  down  time  will  also  be  recorded. 

kJLJL _ Degraded  Operations  Test. 

^■4.2.1 _ Test  Objectives. 

This  test  is  conducted  to  determine  the  acceptability  of  the  resultant  operational 
degradation  when  failures  are  induced  into  the  NAS  system.  Operational  scenarios 
will  be  used  to  verify  TDWR  response  to  TDWR/LLWAS  II  failure  modes. 

^•^•2.2 _ Test  Approach. 

This  test  will  verify  that  the  TDWR  responds  properly  during  the  following 
sc'.^narlos : 

a.  TDWR  and  LLWAS  II  operational, 

b.  TDWR  operational  and  LLWAS  II  nonoperatlonal , 

c.  TDWR  nonoperatlonal  and  LLWAS  II  operational, 

d.  TDWR  and  LLWAS  II  nonoperatlonal. 

In  addition,  proper  TDWR  response  will  be  verified  when  LLWAS--RPG,  LLWAS--GSD, 
and/or  RPG--GSD  link  communications  are  interrupted. 

4.4.3 _ Stress  and  NAS  Loading  Test. 

4.4. 3.1 _ Test  Objectives. 

This  test  will  demonstrate  the  TDWR  response  to  stress  and  NAS  loading  provided  by 
a  weather  scenario  test  tape. 
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iiAJ . 2 _ Test  Approach. 


This  test  will  stress  the  TDWR  by  utilizing  all  available  interfaces  during  periods 
of  hazardous  weather  activity.  This  test  will  involve  playback  of  a  weather 
scenario  test  tape  with  runways  mapped  to  all  lines  of  all  RDTs.  The  LLWAS 
switchover  override  option  will  also  be  enabled  to  more  closely  simulate  a  live 
operational  environment.  In  the  event  significant  hazardous  weather  activity 
occurs  during  the  test  period,  this  test  will  be  conducted  using  a  live  operational 
environment . 

LJlA _ Human  Factors  Evaluation. 

4. 4.4.1  Test  Objectives. 

This  evaluation  will  explore  the  physical  interaction  of  AT  personnel  with  the 
Build  5A  enhancement. 

TVRTM  requirement  3055  will  be  verified  during  this  test. 

. 4 . ? _ Test  Approach. 

ACW-200D  will  monitor  and  observe  tower  and  Terminal  Radar  Approach  Control 
(TRACON)  controllers  and  supervisors  while  using  the  LLWAS/TDWR  data.  A 
questionnaire  will  be  used  to  evaluate  Build  5A  function  useabllity. 

4.4.5  Site -Adaptation  Verification. 

^•'^•5.1 _ Test  Objectives. 

This  test  ensures  that  site  data  unique  to  each  applicable  NAS  facility  has  been 
correctly  developed,  updated,  and  installed  in  the  system. 

4. 4. 5. 2  Test  Approach. 

Site  parameters  will  be  selected  at  random  and  compared  against  the  Site  Survey 
Reports.  If  necessary,  site  setup  utilities  will  be  used  to  verify  these 
parameters.  AOS-230  will  assist  in  the  generation  of  detailed  test  procedures,  and 
will  assist  in  test  conduct. 

4.4.6  Transition  Switchover  Plan. 

4. 4. 6.1  Test  Objectives. 

The  objective  of  this  test  is  to  verify  the  transition  from  the  operational  LX.WAS 
system  to  the  TDWR-LLWAS  interface  system,  and  vice  versa,  does  not  degrade  NAS 
operations  and  minimize  impact  upon  the  user.  A  transition  switchover  will  be 
evaluated  for  both  hardware  and  software  changes. 

4. 4. 6. 2  Test  Approach. 

ACW-200D  will  develop  a  test  procedure  to  ensure  the  transition  switchover  does  not 
degrade  NAS  operations . 
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^■^■7 _ Weather  Performance  Evaluation. 

^.^.7.1 _ Test  Objectives. 


The  objective  of  this  test  is  to  verify  the  TDWR  meets  operational  suitability  and 
reliability  requirements  in  relation  to  its  ability  to  detect  hazardous  weather. 

The  following  TVRTM  requirements  will  be  verified  under  this  test: 

1001,  1003,  1004,  1005,  1006,  1007,  1009,  1020,  1021,  1022, 

1023.  1024,  1025,  3002,  3003,  3004,  3009,  3010,  3011,  3012, 

3014,  3015,  3016,  3017,  3018,  3021,  3022,  3024,  3025. 

7 . 2 _ Test  Approach. 

A  meteorologist  from  the  National  Severe  Storms  Laboratory  (NSSL)  will  conduct  a 
1-week  operation  performance  check  of  the  TDWR  prior  to  the  start  of  Build  5A  0T6eE 
testing.  The  meteorologist  will  verify  Build  5A  does  not  adversely  affect  TDWR 
base  data  quality  or  TDWR  alarms  on  the  GSD  and  RDT. 


5.  TEST  MANAGEMENT. 

5.1  ^OLE?  AW  RE$P0y?lSIUTIEg- 

This  section  describes  the  various  organizations  and  personnel  that  will  manage, 
conduct,  and  support  the  testing. 

_ Test  Management  Organization. 

5 .1.1.1  _ Proaram  Manaaer.  ANR-500. 

The  Program  Manager  (PM)  is  responsible  for  management  of  the  program.  In 
particular,  the  PM  has  responsibilities  for  the  0T6(E  Integration  and  OT6(E 
Operational  test  effort  as  described  in  FAA  Order  1810. 4B.  Specifically,  the  PM: 

a.  Manages  the  overall  T&E  program; 

b.  Arranges  with  the  Associate  Program  Manager  for  Test  (APMT)  for  T&E 
support,  coordination,  and  monitoring; 

c.  Reviews  and  approves  OT&E  Integration  and  OT&E  Operational  test 
requirements,  plans,  procedures,  and  reports; 

d.  Monitors  OT&E  Integration  and  OT&E  Operational  tests. 
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The  Technical  Officer  is  responsible  for  the  technical  direction  of  the  TDWR 
program.  Specific  responsibilities  include; 


a.  System  Design, 

b.  Design  Qualification  Test  and  Evaluation, 

c.  Implementation, 

d.  Logistics  Support. 

?  1..  1 . 3 _ Associate  Program  Manager  for  Test.  ACW-200. 

The  Associate  Program  Manager  for  Test  (APMT)  is  responsible  for  management  of  the 
OTfitE  Integration  and  OT&E  Operational  test  effort.  In  particular,  the  APMT  has 
responsibilities  for  the  OT&E  Integration  and  OT&E  Operational  test  effort  as 
described  in  FAA  Order  1810. 4B.  Specifically,  the  APMT; 

a.  Supports  the  development  of  test  policy  and  test  standards; 

b.  Acts  as  an  agent  of  the  PM  to  manage  the  T&E  program.  This  includes 
establishing  test  schedules,  coordination  of  tests,  ensuring  that  all  test 
requirements  are  satisfied,  and  that  tests  are  performed  in  accordance  with 
approved  procedures; 

c.  Coordinates  with  performing  organizations  and  monitors  OT&E  activities; 

d.  Prepares  OT&E  Integration  and  OT&E  Operational  test  requirements; 

e.  Prepares  OT&E  Integration  and  OT&E  Operational  test  plans,  procedrres, 
and  reports; 

f.  Directs  and  conducts  OT&E  Integration  and  OT&E  Operational  tests. 

5.L2 _ Other  Participating  Organizations. 

This  section  shall  describe  any  specific  roles  and  responsibilities  beyond  those 
described  in  agency  orders  or  directives.  The  description  could  include  just  a 
simple  reference  to  the  directive  (e.g.,  organizational  roles  and  responsibilities 
will  be  as  described  in  FAA  Order  1810. 4B},  but  should  include  some  specific 
information  (e.g.,  the  use  of  operational  user  teams  as  test  subjects  or  test 
observers) . 

5. 1.2.1 _ Operation  Support  Service.  AOS-23Q. 

This  organization  identifies  and  develops,  with  the  PM  and  APMT,  OT&E  Shakedown 
requirements.  In  addition,  they  are  responsible  for  conducting  OT&E  Shakedown 
testing.  They  provide  assistance  and  support  during  the  OT&E  Integration  and  OT&E 
Operational  test  effort  by  reviewing  the  OT&E  Integration  and  OT&E  Operational  Test 
Plan,  Test  Procedures,  and  Test  Reports.  They  also  monitor  0T6iE  Integration  and 
0T£cE  Operational  tests  and  optionally  participate  in  OT6tE  Integration  and  OT&E 
Operational  test  conduct. 


This  organization  provides  operational  expertise  and  planning  for  conducting  and 
analyzing  tests.  They  provide  assistance  and  support  during  the  OT&E  Integration 
and  OT&E  Operational  test  effort  by  reviewing  the  OT&E  Integration  and  OT&E 
Operational  Test  Plan,  Test  Procedures,  and  Test  Reports.  They  also  provide 
personnel  for  conducting  and/or  monitoring  OT&E  Integration  and  OT&E  Operational 
tests . 


5. 1.2. 3  Regional  Airway  Facilities  Division.  AF. 

This  organization  supports  the  APMT  in  the  development  of  OT&E  test  requirements . 
They  participate  in  the  preparation  and  conduct  of  OT&E  Integration  and  OT&E 
Operational  tests  as  coordinated  by  ACW-200. 

5. 1.2. 4  Office  of  Independent  Operational  Test  and  Evaluation  Oversight.  ATQ-1. 

This  organization  provides  assistance  and  support  during  the  OT&E  Integration  and 
OT&E  Operational  test  effort  by  reviewing  the  OT&E  Integration  and  Operational  Test 
Plan,  Test  Procedures,  and  Test  Reports.  In  addition,  they  provide  personnel  to 
monitor  OT&E  Integration  and  OT&E  Operational  tests. 

5. 1.2. 5  Engineering.  Test,  and  Evaluation  Service.  ACN>100. 

This  organization  provides  assistance  and  support  during  the  OT&E  Integration  and 
OT&E  Operational  test  effort  by  preparing  and  executing  the  RMMS  test  procedures. 
They  will  then  provide  ACW-200  with  a  test  report  for  inclusion  into  the  OT£(E 
Integration  and  OT&E  Operational  Test  Report. 

_ National  Severe  Storms  Laboratory.  NSSL. 

This  organization  provides  meteorological  assistance  and  support  during  the  OT£(E 
Integration  and  OT&E  Operational  test  effort  by  verifying  TDWR  base  data  and 
weather  products.  They  will  then  provide  ACW-200  with  a  test  report  for  inclusion 
into  the  OT&E  Integration  and  OT&E  Operational  Test  Report. 

5.1.3  Test  Conduct  Team. 

This  section  describes  the  responsibilities  of  the  test  team. 

5 .1.3.1  Test  Director.  ACW-200. 

The  Test  Director  is  appointed  by  the  APMT.  Specifically,  the  Test  Director: 

a.  Ensures  the  OT&E  Integration  and  OT&E  Operational  test  effort  follows  the 
specific  test  plan  and  procedures; 

b.  Ensures  all  required  equipment  and  personnel  are  available  prior  to  the 
start  of  the  test; 

c.  Ensures  all  relevant  data  for  analysis  is  collected; 
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d.  Maintains  a  daily  test  log; 

e.  Conducts  pretest  and  post-test  briefings; 

f.  Provides  the  status  of  all  testing  activities  to  the  APMT. 

5.1,?. 2 _ Test  Manaser. 

A  Test  Manager  is  not  needed  for  the  TDWR  0T££  Integration  and  OT&E  Operational 
testing. 

5. 1.3.3  Test  Operators.  ACW-200.  AOS-23Q.  ATR-120.  ACN-100.  AF. 

Test  Operators  are  responsible  for  manning  the  test  positions  during  a  particular 
test.  They  follow  the  test  procedures  and  record  all  test  results.  In  addition, 
they  will  assist  the  Test  Director  in  maintaining  the  daily  test  log.  The  Test 
Operators  report  to  the  Test  Director. 

5U.3..4  Test  Monitors.  ACW-200.  AOS-230.  ATR-120.  NSSL. 

Test  Monitors  are  responsible  for  ensuring  that  the  test  scenarios  and  procedures 
are  being  followed  by  the  Test  Operators.  Test  Monitors  assist  the  Test  Operators 
by  reporting  observations ,  assisting  in  the  recording  of  measurements ,  and  keeping 
track  of  day-to-day  activities  by  maintaining  test  logs. 

?.l.?.? _ Test  Witness.  ATO-1. 

Test  Witness  personnel  are  official  FAA  representatives  that  witness  the  test  and 
provide  a  written  assessment  verifying  compliance  to  accepted  test  plans  ard 
procedures . 

5.2  TRAINING. 

The  following  paragraphs  will  describe  the  training  needed  to  develop  and  execute 
the  OT&E  Integration  and  Operational  test  procedures. 

5,..2..i _ Test  Developer  Training. 

No  formal  TDWR  training  is  required  for  test  procedure  development  and  execution. 
However,  a  thorough  understanding  of  TDWR  system  operation  including  the  use  of  the 
System  MDT,  RPG/RMS  MDT,  BDD,  BDR,  GSDs,  and  RDTs  is  required. 

5.2.2  _ Test  Participant  Training. 

Test  participants  should  also  be  familiar  with  overall  TDWR  system  operations 
including  the  MDTs,  BDR,  and  all  displays. 

3.2.3  _ Sector  Maintenance  Support  Training. 

The  Memphis  Sector  Field  Office  (MEM-SFO)  technicians  shall  have  undergone  the 
280 -hour  FAA  TDWR  Maintenance  Training  course  in  order  to  provide  adequate 
maintenance  support  to  the  Test  Director. 
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ACW  will  ensure  specially  trained  Individuals  are  available  to  operate  the 
anemometer  simulator  and  the  protocol  analyzer. 

5.3  TEST  CONDUCT. 

5.3.1  Quali£VL  Control  and  Configuration  Management . 

AOS-230  will  officially  provide  software.  Version  Numbers/Checksums  will  be  as 
Indicated  In  AOS-230  Site  Program  Bulletin  (SPB).  Testing  software  will  be 
validated  as  follows: 

a.  RPG/RMS  -  System  MDT  Data  Processor  Performance  Screen,  Version  Number 
should  be  the  same  as  Indicated  In  the  SPB. 

b.  DFU  -  System  MDT  DFU  Performance  Screen,  Version  Number  should  be  the 
same  as  Indicated  In  the  SPB. 

c.  DSP  -  System  MDT  Channel  A/B  Performance  Screen,  DSP  Checksum  should  be 
the  same  as  Indicated  In  the  SPB. 

d.  Antenna  •  System  MDT  Antenna  Performance  Screen,  Antenna  Checksum  should 
be  the  same  as  Indicated  In  the  SPB. 

e.  Transmitter  •  System  MDT  Transmitter  Performance  Screen,  Transmitter 
Checksum  should  be  the  same  as  Indicated  In  the  SPB. 

5.3.2  _ Test  Readiness  Criteria. 

ACW*200D  will  conduct  Build  5A  OT&E  Integration  and  OT&E  Operational  tests 
after  contractor  on*slte  Design  Qualification  Tests  (DQT)  are  completed  and  a 
configuration  audit  Is  performed. 

5.4  test  REPQRTS- 

The  following  subsections  define  the  necessary  reports  that  will  be  generated 
during  OT&E  Integration  and  OT&E  Operational  testing. 

5.4.1  Individual  Test  Results  Reporting. 

Individual  test  results  will  be  recorded  by  Test  Operators  In  the  spaces  provided 
in  each  test  procedure.  At  the  conclusion  of  each  test,  a  summary  of  the  test 
results  will  be  Included  In  the  test  procedure. 

5.4.2  Service  Reports. 

The  Test  Director  will  ensure  all  test  discrepancies  and  problems  observed  during 
testing  are  documented  in  Seirvice  Reports  (SR).  The  SRs  will  be  forwarded  to  the 
Program  Office  for  resolution.  The  Service  Report  format  will  be  the  same  as  In 
previous  TDWR  OT&E  testing. 
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_ Eerlttdic  Test  Status  Reports/Brleflnes. 


This  paragraph  identifies  the  type  of  briefings  that  will  be  conducted  throughout 
OT&E  Integration  and  OT&E  Operational  testing. 

5. 3.1 _ Pretest  Briefings. 

This  briefing,  chaired  by  the  Test  Director,  will  be  scheduled  ismediately  prior  to 
the  start  of  each  test  and  attended  by  all  personnel  participating  in  the  test. 

The  pretest  briefing  will  Include  the  status  of  prerequisites,  software,  system 
equipment,  test  equipment,  and  a  test  summary. 

The  pretest  briefing  consists  of  a  brief  explanation  of  the  type  of  test  that  will 
be  conducted,  what  the  test  will  attempt  to  accomplish,  and  the  hardware/software 
configuration  that  will  be  utilized  for  the  test.  The  pretest  briefing  will  also 
accomplish  the  following: 

a.  Identiiy  any  needed  changes  and  red-line  the  procedures  accordingly; 

b.  Review  the  hardware  and  software  configurations  of  the  test  environment; 

c.  Ensure  that  all  items  in  the  material  checklist  (contained  in  the  test 
procedures)  have  been  received; 

d.  Provide  Service  Report  forms  to  attendees; 

e.  Generate  a  record  of  the  pretest  briefing. 

5.4. 3.2  Post-Test  Briefing. 

This  briefing  will  be  conducted  shortly  after  test  completion.  It  is  chaired  by 
the  Test  Director  and  attended  by  all  test  personnel.  The  purpose  of  the  meeting 
is  to  review  the  results  of  the  test  activity.  An  assessment  of  the  quality  of  the 
test  and  the  impact  of  the  problems  (l.e.,  SRs)  will  be  discussed  during  the  review 
of  the  Test  Director's  post- test  briefing  package. 

The  post- test  briefing  package,  prepared  by  the  Test  Director  prior  to  the 
post-test  briefing,  should  consist  of  the  following: 

a.  The  "as -run"  hardware  and  software  configuration,  how  it  differed  from 
that  stated  in  the  procedures,  and  its  significance  to  the  test  results; 

b.  Any  deviations,  planned  and  unplanned,  in  the  test  procedure  steps  and 
their  significance  to  the  test  results.  Procedure  steps  with  problems  noted  and/or 
SRs  initiated  against  them  should  be  rescheduled  for  retest; 

c.  Any  discrepancies,  anomalies,  and  exceptions  that  were  recorded  during 
the  test  and  their  significance  to  the  test  results; 

d.  A  summary  of  the  outcome  of  the  test.  This  summary  can  be  derived  by 
reviewing  the  test  logs,  test  data,  and  SRs  that  were  generated. 
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^.4.3.3 _ Status  Btifi£ings- 


These  briefings  will  serve  to  keep  the  TOWR  Test  Support  Group  abreast  of  the 
status  of  OT&E  Integration  and  OT&E  Operational  testing.  These  meetings  will  be 
chaired  by  ACU-200  and  will  commence  Just  prior  to  the  start  of  OT&E  Integration 
and  OT&E  Operational  testing.  They  will  serve  as  a  technical  interchange  of  issues 
and  concerns. 

5.4.4  Quick  Look  Report. 

A  Quick  Look  report  will  be  written  within  10  working  days  after  test  completion. 
This  report  will  include  a  description  of  the  test,  a  summary  of  test  activities, 
significant  test  results  that  are  known  at  the  time,  and  test  result  conclusions. 

It  will  provide  an  immediate  indication  of  the  outcome  of  the  test  and  highlight 
test  discrepancies  noted  during  test  execution  and  their  significance. 

The  Quick  Look  Test  Report  will  contain  the  following: 

a.  Quick  Look  Test  Report  title  page. 

b .  Executive  Sunmary . 

c.  Introduction. 

d.  OT&E  Description. 

e .  Results . 

f.  Conclusions. 

_ Final  Report. 

The  TDUR  Test  Director  will  be  responsible  for  preparing  a  Final  Test  report.  A 
Draft  report  will  be  delivered  to  the  Program  Manager  30  days  after  the  cospletion 
of  OT&E  Integration  and  OT&E  Operational  testing.  The  Final  Test  Report  will 
document  the  results  of  detailed  test  analysis,  and  assess  the  compliance  of  each 
test  to  defined  criteria.  The  status  of  problems  identified  previously  in  the 
Quick  Look  Test  Reports  will  be  updated,  a  revised  assessment  will  be  made  of  their 
impact  on  the  tested  system,  and  the  suggested  corrective  actions  required.  Any 
new  problems  discovered  by  detailed  evaluation  will  be  identified  and  their  impact 
in  the  system  described. 

The  Final  Test  Report  will  contain  the  following: 

a.  Final  Test  Report  title  page. 

b.  Executive  Summary. 

c.  Table  of  Contents. 

d.  Introduction. 

e .  Doctuaents  referenced . 

f.  System  Description. 

g.  Test  Description. 

h.  Results  and  Discussion. 

i.  Conclusions. 

j .  Recommendations . 

k.  Acronyms  and  Abbreviations. 
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5.5  SCHEDULES  AND  PERSONNEL  REQUIREMENTS. 


This  section  Includes  the  overall  schedule  of  TDUR  Build  SA  OT&E  events  and 
personnel  requirements  for  OT&E  Integration  and  OT&E  Operational  testing. 

i.5,1 _ Test  Schedule. 

This  section  presents  the  schedules  for  TOWR  0T££  Integration  and  OT&E  Operational 
activities.  TDWR  OT&E  activities  are  traceable  and  supportive  of  the  TDWR  TEMP. 

This  schedule  indicates  the  TDWR  OT&E  Test  Activity  as  shown  in  figure  5. 5. 1-1. 

The  schedule  is  developed,  released,  and  controlled  by  the  Test  Director,  ACV-200. 
The  function  of  this  schedule  is  to  provide  direction  to  all  TDWR  activities.  They 
identify  the  major  tasks  to  be  accomplished  (e.g..  Test  Plan  and  Test  Procedures 
complete)  and  identify  task  start  and  stop  dates.  This  schedule  enables  the  Test 
Director  to  provide  detailed  test  status  to  the  test  groups. 

?.5,2 _ Personnel  Resource  Requirements. 

The  personnel  requirements  for  OT&E  Integration  and  OT&E  Operational  test  conduct 
are  included  in  table  5. 5. 2-1. 
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FIGURE  5. 5.1-1.  T0WR  BUILD  5A  0T4E  TEST  ACTIVITY 


TABLE  5. 5. 2-1.  TDWR  OT&E  INTEGRATION  AND  OT&E  OPERATIONAL  TEST  SUPPORT  PERSONNEL 


grMnigatifln 

No.  Of  People 

Position 

ACW-200D 

1 

Test  Director 

ACU-200D 

1/1 

Test  Monitor/Operator 

AF  Field  Personnel 

1-2 

Test  Operator 

AOS -230 

1-2 

Test  Monitor/Operator 

ATR-120 

1 

Test  Monitor/Operator 

ACN-lOO 

2 

Test  Operator 

ATQ-1 

1 

Test  Witness 

NSSL 

1 

Test  Monitor 

ANR-900 

1 

Test  Witness 

Note:  Not  all  of  these  organizations  will  be  present  during  every  test.  The  test 
procedures  will  Identify  appropriate  personnel. 
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6.  ■  ACRONYMS  AND  ABBREVIATIONS. 


A 

ACN 

ACU 

AF 

ANR 

ANT 

APMT 

AOS 

AT 

ATC 

ATR 

ATQ 

BDD 

BDR 

bps 

CFW 

CMTP 

CMU 

COTS 

CSCI 

D 

DFU 

DPL 

DPO 

DQT 

DSP 

DT&E 

FAA 

FAAAC 

GSD 

HWCI 

I 

IMCS 

LLWAS 

MDT 

MEM 

M&OS 

MPS 

MTBF 

MTBCF 

MTS 

NAS 

NSSL 

OT&E 

PM 

PSF 

RDA 

RDT 

REX 

RMMS 


Analysis 

Engineering,  Test,  and  Evaluation  Service,  FAA  Technical  Center 

Weather  and  Primary  Radar  Division,  FAA  Technical  Center 

Airways  Facilities 

Program  Director  for  Weather  Radar 

Antenna 

Associate  Program  Manager  for  Test 

Systems  Maintenance  Service,  FAA  Aeronautical  Center 

Air  Traffic 

Air  Traffic  Control 

Air  Traffic  Plans  and  Requirements  Service 

Office  of  Independent  Operational  Test  and  Evaluation  Oversight 

Base  Data  Display 

Base  Data  Recorder 

Bits  per  second 

Center  Field  Wind 

Contractor's  Master  Test  Plan 

Concrete  Masonry  Unit 

Commerc ial - Of f - The - Shelf 

Computer  Software  Configuration  Item 

Demonstration 

Display  Functional  Unit 

Display  Computer 

Data  Processing  Operating  System 
Design  Qualification  Test 
Digital  Signal  Processor 
Development  Test  and  Evaluation 
Federal  Aviation  Administration 

Federal  Aviation  Administration  Aeronautical  Center 
Geographical  Situation  Display 
Hardware  Configuration  Item 
Inspection 

Interim  Monitor  and  Control  Software 
Low  Level  Wind  Shear  Alert  System 
Maintenance  Data  Terminal 

Terminal  Doppler  Weather  Radar  site  in  Memphis,  TN 

Maintenance  and  Operations  Support 

Maintenance  Processor  Subsystem 

Mean  Time  Between  Failure 

Mean  Time  Between  Critical  Failure 

Moving  Target  Simulator 

National  Airspace  System 

National  Severe  Storms  Laboratory 

Operational  Test  and  Evaluation 

Program  Manager 

Program  Support  Facility 

Radar  Data  Acquisition 

Ribbon  Display  Terminal 

Rece i ve r/Exc iter 

Remote  Maintenance  Monitoring  System 
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RMS 

RPG 

SCU 

SDT 

SFO 

SPB 

SPT 

SR 

T 

TCCC 

TDWR 

T&E 

TEMP 

TRACON 

TTL 

TVRTM 

UN1X_UNX 

VRTM 

VTX 

X 

XMT 


Renote  Monitoring  Subsystem 
Radar  Product  Generator 
Servo  Control  Unit 
Software  Development  Tools 
Sector  Field  Office 
Site  Program  Bulletin 
Special  Test  Equipment 
Service  Report 
Test 

Tower  Control  Computer  Complex 

Terminal  Doppler  Weather  Radar 

Test  and  Evaluation 

Test  and  Evaluation  Master  Plan 

Terminal  Radar  Approach  Control  Facility 

Test  Tools  Library 

Test  Verification  Requirements  Traceability  Matrix 

Display  System  Operating  System 

Verification  Requirements  Traceability  Matrix 

VRTX-32  Operating  System 

Not  Applicable 

Transmitter 


32 


APPENDIX  A 

TEST  VERIFICATION  REQUIREMENTS  TRACEABILITY  MATRIX  (TVRTM) 


Terminal  Doppler  Weather  Radar 

NAS-SS-IOOO  Volume  I  Test  Verification  Requirements  Traceability  Matrix 


Terminal  Doppler  Weather  Radar 

NAS-SS-IOOO  Volume  I  Test  Verification  Requirements  Traceability  Matrix 


Vcriflcaiion  Methods:  1'sTcsl.  n=l)einonsiialion,  A=Aiialysis.  l=inspeaion.  x=Nol  Applicable 


Terminal  Doppler  Weather  Radar 

NAS-SS-IOOO  Volume  I  Test  Verification  Requirements  Traceability  Matrix 
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Verificaiion  Methods:  T=Tesl,  DsDcmonstralion.  A=Analysis.  l=lnspection,  x=Nol  Applicable 


Terminal  Doppler  Weather  Radar 

NAS-SS-IOOO  Volume  HI  Test  Verification  Requirements  Traceability  Matrix 
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Vcriricalion  Methods;  T=Tesi.  I)=Demonsiralion.  A=Ana]ysis.  l=liispection,  x=Nol  Applicable 


Terminal  Doppler  Weather  Radar 

NAS-SS-IOOO  Volume  III  Test  Verification  Requirements  Traceability  Matrix 
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Terminal  Doppler  Weather  Radar 

NAS-SS-IOOO  Volume  III  Test  Verification  Requirements  Traceability  Matrix 
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Vcriricalion  Methods:  1'=1'esl,  I)sDemonslraiion.  A^Analysis,  l^lnspection,  x=Noi  Applicable 
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VerificaakNi  Methodi:  TsTai.  DBDemoutraikNi.  AsAnalysis.  Nlrapection.  ii=Noi  Applicable 


